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ABSTRACT 


The  estimation  of  a  variance  ratio  6  =  t  /t  iy  studied  under 

restrictions  c  >  5^  or  f  <  6^.  We  assume  first  th*t  we  observe 

^ ^  t . ,  independent.  ~A  Bayesian  viewpoint  is  taken.  We  then 
i 

assume  additional  information  on  Ty  is  available  in  the  form  of 

*  2 

an  independent  observation  from  a  nonoentral  x  distribution.  A 
natural  application  arises  when  the  tf.  are  sums  of  squares  in  a 
variance  components  model.  _  ^ 


/ 


1  .""'''INTRODUCTION 


In  this  paper  we  consider  the  estimation  of  a  variance  ratio 

2 

over  a  truncated  parameter  space.  Suppose  that  U.  ^  * .x 


in. 

l 


1,2,  independent,  n1  >5,  n2  -  3"  Let  5  =  T2^T1*  Under  the 


scale  invariant  quadratic  loss  function 

L(^,a)  =  r“2(-  -  a)2 


the  estimator 


nl  '  4  U2 


(1.1) 

(l.:: 


is  best  invariant  in  the  class  based  upon  U_/L’  .  In  fact,  using 
the  approach  of  Brown  and  Fox  (1974),  it  is  straightforward  to 
establish  that  is  admissible  under  (1.1).  (See  Gelfand  and 
Dev  (1986)  for  details.)  Suppose  we  restrict  6,  r  <_  r  or 
r  _>  5q.  Such  restrictions  arise  naturally  when,  for  example,  the 
U.  are  sums  of  squares  in  a  variance  components  model.  Then  6q 


1 


is  no  longer  admissible.  A  usual  approach  to  dominating  6^  is  to 


restrict  6^  in  the  same  fashion  that  6  is  restricted 


Such  esti¬ 
mators  are  no  longer  smooth,  hence  inadmissible.  From  a  Bayesian 
viewpoint,  such  an  approach  is  essentially  taking  the  posterior 
mode  resulting  from  a  prior  over  the  restricted  6pace .  An  alter¬ 
native  is  to  take  the  posterior  mean.  Such  estimators  will  be 
admissible,  but  exhibit  strange  behavior.  In  Section  2  we  look 
into  all  of  these  issues  drawing  upon  ideas  of  Hill  (1965)  and 
recent  work  of  Loh  (1986). 

A  broader  setting  presumes  that  we  have  additional  informa- 

2  2 

tion  about  the  t.  in  the  form  of  V.  *v  t.x  ,  or  V.'v  (t.+$.)x  > 

l  i  l  m. ,X.  i  i  i  m. 

l  i  l 


i  =  1,2,  independent  of  IK  and  of  each  other. 


Now  is  no 


longer  admissible  for  6  under  (1.1).  An  example  is  that  of  X.. 


77  s2 


'v  N(u  .  ,t  .  )  ,  i  =  1,2,  j  =  1 , .  . .  ,n.  ,  with  U.  =  E(X..-X.)  .  Then 

i*  i  i  i_  _  ij  1 

(1.2)  is  not  admissible  for  6.  In  fact,  (X^ ,X^ ,U^ )  is  a 

version  of  the  complete,  sufficient  statistic  and  the  X.  (hence 

—2  1 
Xt )  contain  information  about  t..  (Gelfand  and  Dey  (1986)  dis- 
l  l 

cuss  this  example  at  length.)  In  this  broader  setting,  we  again 
seek  to  estimate  a  restricted  6.  This  problem  is  the  issue  of 
Section  3,  drawing  upon  ideas  dating  to  Stein  (1964),  Brown  (1968) 
and  Klotz,  Milton  and  Zacks  (1969). 

The  seminal  paper  by  Katz  (1961)  on  admissibility  for  esti¬ 
mators  of  restricted  parameters  is  inapplicable  here  since  the 
distribution  of  W  =  l^/U^  does  not  belong  to  the  exponential 
family . 

2.  THE  BAYESIAN  APPROACH 


In  the  spirit  of  variance  components  models,  let  =  ar,^ 

+  br^,  t2  =  cn^  +  d^2  where  ru  >  0,  a,b,c,d  ^  0  and  r  =  ad  -  be 

#  0.  We  necessarily  have  6..  ^  6  <  where  0.  =  min(a  ^c,  b  ^d), 
-1-1  12  1 
^2  =  max(a  c,  b  d).  If  a  or  b  =  0  (c  or  d  =  0) ,  we  obtain  a 

one-sided  restriction  below  (above). 

Example :  In  the  balanced  one-way  ANOVA,  i.e.,  =  y  +  +  E£j> 

i  =  1,...,I,  j  =  1 . J,  with  a.  ^N(0,o^),  e..  'v- N(0,o^)  all 

independent,  we  have  IK  =  ZI(Y..-Y.)  ,  U_  -  JI(Y.  -Y  )^,  n. 

1  .  1 J  1*  fc  X .  •  •  1 

=  I(J-l),  n2  =  1-1,  =  o^,  =  0q»  a  =  1,  b  =  0 ,  c  =  1,  d  =  J 

and  e  >  1 . 


2 


We  now  develop  the  relevant  distribution  theory.  We  assume 
a  prior  over  n^,  ^  of  the  form  tt  (n^ )  *n  (ri^ )  with  ^  having  a 
gamma  distribution,  i.e., 

-(k.+l)  -A./n. 

ir(n,)«  n .  1  e  1  x,  i  =  1,2.  (2.1) 

1  i 

Hill  (1965,  p.  811)  argues  for  the  plausibility  of  the  independence 
assumption  in  the  context  of  variance  components.  The  resulting 
prior  for  t ^ on  the  domain  B^x^  <_  \ ^  <.  ®2T2 


-(k  +k  +2)  -(k.+l)  -(k.+l) 

TT^Tl’T2^ar  (dx1-bi2)  (aT2-cTx) 


exp 


/  x1(aT2-cT1)+A2(dT1-bT2)  | 

\  r  (dx1-bT2)(aT2-CT1)  J 


(2.2) 


The  non in formative  prior  on  n.  arises  as  the  limiting  case 

1 

k.  =  0,  A.  =  0  in  (2.1)  and  induces  [  (dx , -bx „)  •  (ax.-cx. )]  as  the 
i  i  12  2  1 

prior  for  x  *x„.  This  differs  from  the  noninformative  prior  of 
Box  and  Tiao  (1973,  p.  253),  (x^* t2)  which  cannot  arise  from 
independent  ru  unless  the  transformation  from  ru  to  x^  is  trivial 
and  has  been  criticized  in  the  variance  components  case  for  its 
dependence  in  the  n  space  upon  the  sample  size  J. 

From  (2.2) 


tt(6) 


k  -1  k  -1  k  +k  -2 

(a6-c)  (d-b6)  1  r 


(Ax(a6-c)  +  A2(d-b6)) 


kx+k2  *  61  -  6  -  62’  (2'3) 


i.e.,  6  follows  a  generalized  Beta  distribution.  Two  cases  of 
(2.3)  which  we  study  in  greater  detail  are: 


v1 

(e-eo} 

TT<e)a - -  ~t~ zt  .  e  >  e  , 

2 


(i+A(e-e0)) 


o 


(2.4) 


i.e.,  A (6-6q)  follows  a  nonstandardized  F  distribution  or  limit 
thereof  and 


k.-l  k  -1 

tt( e)  *  e  (0Q-9)  »  o  <  e  <  0O, 


(2.5) 


i.e.,  &/<?q  follows  a  Beta  distribution  or  limit  thereof. 

Under  (2.1)  the  posterior  distribution  of  6  given  the  data 
is 


3 


e(&|u1,u2) 

nl+n2  nl+n2 

-  +k  -1  +k  -1  k.+k  -2 

a  (d-bfr)  _  1  (ae-c)  1  1  r  1  1 _ 

n2  ni+n2 

-4  (u  e+u  )(d-be) (ae-c)  ■  +k  +k 

e  z  [  — - - - — - -  +x1(ae-c)+x2(d-be)] 

(2.6) 

Since  (2.6)  is  analytically  intractable,  we  consider  instead 
the  simpler  posterior  of  6 1 V7  =  The  distribution  of  w|e  is 

a  nonstandardized  F,  i.e., 

nl  nl  , 

”l  n2.  2  2  1 

i( — = — )  6  w 

f(w|e)  =  2 


n  n 

*  \  n/ 


n 


(2.7) 


r(y-)  r(y-)  (l+6w)  2 


whence  under  (2.1) 


C(6 |w)  « 


k  -1  k  -1  n  /2  k  +k  -2 

(a0-c)  (d-be)  6  r  1  2 


kl+k2 

.a  M  1 


ni+n2  • 


(2.8) 


[X j (a6-c )+X2 (d-be )]  (l+6w)  2 


In  the  special  case  (2.4)  with  X  =  ,-  we  obtain 

kl_1  Y  "(k.+k  ) 

(e-e  )  1  e2  12 
c (6  | w)  «  - - -  ,  6  >  6 

nj+n2  -  0 


(2.9) 


( l+6w) 

In  the  special  case  (2.5),  we  obtain 


nl 

—  +k  -1  k  -1 

e  (6o"6) 

£(e |w)  - - — - — -  ,  o  <  e  <  e_  . 

nx+n2  -  -  0 


(2.10) 


(l+6w) 


The  case  k^  =  1,  k^  =  0  in  (2.9)  or  k^  =  0,  “  1  in  (2.10) 

produces  the  posterior  associated  with  the  Box-Tiao  prior. 

Turning  to  estimation  of  6,  we  first  consider  the  posterior 
mode  in  (2.9)  and  (2.10).  If  kj  <  1  in  (2.9)  or  k;  <  1  in  (2.10), 
the  mode  occurs  at  6Q.  If  kj  >  1  in  (2.9)  or  k2  >  1  in  (2.10),  the 
the  posterior  need  not  be  unimodal.  However,  if  in  (2.9),  k^  =  1 
and  k2  <  (n^-2)/2,  we  obtain  a  unique  mode  at 


4 


(2.11) 


(2.12) 


_  _i  n.-2(k2+l) 

d.  =  max(6  W  - rr; - rr)  . 

k2,e0  O’  n2+2(k2+l) 

If  in  (2.10),  k2  =  1  and  k^  <  (n2+2)/2,  we  obtain  a  unique  mode  at 

n  +2(k  -1) 

d  =  min(0  V  - tjt — r-r) . 

~kl>Q0  0  n2-2(k1-l) 

Note  that  k^  =  1  in  (2.4),  k2  ==  1  in  (2.5)  asserts  prior  informa¬ 
tion  concentrated  near  8^. 

As  remarked  earlier  (2.11)  and  (2.12)  are  not  admissible. 

In  particular  for  k2  <  (n1+n2~2)  1(n2+2),  max(e 0,<5Q)  »  <5Q  as  in 
(1.2)  dominates  (2.11)  using  the  fact  that  6^  is  best  invariant  in 
the  unrestricted  problem  and  Lemma  1  of  the  appendix.  However, 
min(6g,d  )  does  not  dominate  (2.12)  by  using  the  same  argument  as 
in  Loh  (1986,  p.  700). 

Consider  now  formal  Bayes  rules  extending  the  loss  (1.1)  to 

2 

L(e,a)  =  ec(e-a)  (2.13) 

where  c  is  arbitrary. 

We  recall  that  if  0  <  a  <  b 


f0  d6  =  w"a  r(a)T(b-a) 


0  (l+6w) 


r(b) 


I  (a,b-a) 


(2.14) 


where  1^  (a,b-a)  is  the  incomplete  Beta  function  evaluated  at 

=  (l+e0w)_1eow. 

Consider  first  the  case  6  _>  6^.  Under  (2.9)  with  loss 

(2.13),  let  m.  =  n  /2  +c+l-(k1 +k0 )+ j  and  £.  =(n1+n_V2  -m..  If  k. 

jl  12  j  IT  j  1 

is  a  positive  integer  and  m^  >  0  using  (2.14),  we  can  obtain  the 
unique  Bayes  rule  as 


>^2 5  *■  > 


k-1  k.-l  •  ”tn. 

i  (  .  )e”Jw  Jr(tD.+i)r(£.-i)i1  (£.-i,m.+i) 

=  w-i  ] _ °  ]  J  1-ri°  J  ] 

kl_1  k-1  _.  -m. 

I  (  .  )enJW  Jr(m.)r(£.)l1  (£.,m.) 

j-0  J  °  J  J  1_n0  J  J 

(2.15) 

Similarly,  if  0  <_  e  <_  6q  ,  under  (2.10)  with  loss  (2.13),  let 
mj  _  n^/2  +c+k^+j  and  £^  =(n^+n2)/2  -m j .  if  k2  is  a  positive 


5 


integer  using  (2. 14),  we  can  obtain  the  unique  Bayes  rule  as 


-k1>k2,c,e() 


k2-1  k  -1  .  -m. 

I  (  .  )6"JW  Jr(m.+l)r(£.-l)l  (m . +1 , £ . “1 ) 

-1  j-o  J  0  J  J  n  J  J 

=  W 


k2  1  k  -1  .  -m. 


I  (  *  )e"JW  Jr(m.)r(£.)l  (m.,£.) 

j-0  J  °  3  3  «0  3  3 


(2.16) 


Remark  1 :  Expression  (2.15)  depends  upon  c  and  k2  through 

c  -  k„  =  Y-  so  we  can  denote  it  by  6.  ;  expression  (2.16) 

1  1  K1,Y2’  0 
depends  upon  c  and  through  c  +  k^  =  so  we  can  denote  it  by 

— Y  k  £  * 

*1’  2’  0 

Remark  2 :  Computation  of  (2.15)  and  (2.16)  requires  calculation  of 
the  incomplete  Beta  functions  only  for,  say,  the  denominator  by 
using  the  well-known  relationship  (see,  e.g.,  Abramovitz  and 
Stegun,  1965) 

V”1’  d-i>  ■ 


Remark  3 :  Using  Lemma  2  of  the  appendix,  we  may  show  that 

.-1 


lim  d. 


=  6, 


kl_1  k  -1 
I  (  .  )(£.-l) 

1=0  J  J 


>  f. 


kljY2’60  °  kl_1  k  -1 

l  (  -  )  £ 
j-0  J  J 

k2~^  k  -1 

*  k2  1  J  -1 

Z  (  .  )ej!(m.+i)  1 

1=0  J  0  J 

^^l-k2’60  °' 


1  im  6 


l  (  2 .  )eJ(m.)_1 
j-0  J  0  J 

In  this  sense  the  behavior  of  6,  6  differs  strikingly  from 
that  of  d,  d  as  W  approaches  the  extremes  of  its  domain.  The  latter 
have  positive  probability  of  equaling  6^.  Loh's  Theorem  3.1  shows 
a  special  case  of  this. 

Remark  4:  Paralleling  (2.11)  and  (2.12)  when  k^  =  1,  we  obtain 


6 


1  ,Y2,60 


-1  V2^2 

V  1  ( _ i _ z _ )  , 

*  ^n2-2h24l); 


n  n 

Xl-r,  (T  +  ^2  4  l>  T  '  V1} 


nl  n2 

1l-r,0(T  "V  T  “  Y2^ 


and  when  k2  =  1  in  (2.16)  we  obtain 


-i  v2li 


nl  n2 

i  <- r  v-  -y,*1) 

'o  2  1  2  1  - 


.L-  1  f- 

1  ’  *'0 


'V2TVT5  ,  ,ni  _  n2  , 

V2  v 2  1[> 


The  estimators (2 . 15)  and  (2.16)  are  admissible  under  (1.1) 
within  the  class  of  rules  based  upon  V.  However,  admissibility  in 
the  larger  class  based  upon  ,  t;2  (equivalently  W,  Uj )  is  a  more 
difficult  question.  The  approach  of  Brown  and  Fox  (1974)  mentioned 
after  (1.2)  is  not  applicable  to  a  restricted  parameter  space. 


3.  ADDITIONAL  INFORMATION  ABOUT  i 


Recalling  the  notation  of  Section  1,  suppose  V.  t.>;  ,  . 

i*  i 

Ke  have  the  following  results  whose  proof  is  essentially  contained 
in  Stein  (1964)  or  Strawderman  (1974). 

Result  1:  In  estimating  *  under  squared  error  loss, 

tnin{(n2+2)  1  1’2 ,  (m0+n2+2)  *  (l^+Vj)}  dominates  (n2+2)  *  1'2  . 
Result  2:  In  estimating  under  squared  error  loss, 

max{(n^-4)  U  * ,  (mj+n^-4)(l’^+Yj )  *}  dominates  (n^-4)  U 


7 


If  instead  V .  'v  (t  .  +  4  . )  x  ,  Results  1  and  2  still  hold, 
ill  nu 

That  is,  we  may  think  of  V.  arising  from  V.lz.  =  z.  t  .y 

i  6  l1  l  l  iAm . , z . 

2 

where  ^  ((fc^/Zi^)^  •  Since  Results  1  and  2  hold  regardless  of 
Z^ ,  they  hold  unconditionally.  Klotz,  Milton  and  Zacks  (1969, 
p.  1392)  allude  to  this  idea  in  a  special  case. 

Taking  these  ideas  further  to  the  estimation  of  an  unrestrict¬ 
ed  variance  ratio  using  essentially  the  proof  of  Theorem  3.1  in 
Gelfand  and  Dey  (1986),  we  can  show 
Result  3:  In  estimating  6  under  squared  error  loss, 

(n1~4)  (U2+V2) 

4  =  min(60,  — —  •  ^^2  )  -  60  dominates  60 


L  =  max (6 


O’  n2+2 


2  2 
m^+n^-4 

“vV 


) 


>_  dominates  6^ 


By  Lemma  1  of  the  appendix,  we  have  immediately  that  with 
squared  error  loss  under  the  restriction  6  _>  0Q, 

max(^.,6p)  dominates  raax(6p,0o) 


(3.1) 


and  under  the  restriction  0  <_  6  <_  6^, 

min(A,feQ)  dominates  min(6Q .Bq) .  (3.2) 

In  Gelfand  and  Dey  other  estimators  (e.g.,  using  ideas  of 
Brown,  1968)  which  dominate  6^  in  the  unrestricted  problem  are 
given.  These  estimators  may  be  used  to  obtain  results  similar  to 
(3.1)  and  (3.2).  We  omit  the  details 


APPENDIX 

Lemma  1 :  Under  squared  error  loss 

(a)  If  T  dominates  U  on  ^  <  e  and  T  <_  U,  then  max(T,6Q) 
dominates  maxCU^^)  on  0^  _<  6. 

(b)  If  T  dominates  U  on  0  <  6  <  6^  and  T  >_  U,  then  min(T,0p) 
dominates  min(U,6p)  on  0  <  8  <  0^. 

Proof :  The  proof  is  essentially  that  of  a  lemma  in  Klotz,  Milton 

and  Zacks  (1969,  p.  1394). 

Lemma  2 :  In  the  notation  of  (2.14), 


*3 

lim  w  I  (a,b-a) 
w+0  n0 


T(b) 

r(a+l)r(b-a) 


0 


a 

0 
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(A.  1) 


or 


equivalently 


lim  w*  Il-r,  (a>b"a)  =  r(a+l)r(b-a^  ^  '  (A,2) 

v-*-x  0 

Proof :  Since  the  limit  as  w  -*■  0  of  the  left-hand  6ide  in  (2.14) 

is  6a/a,  we  obtain  (A.l).  But  (A. 2)  follows  by  replacing  w  with 
_1  w  _i 

w  and  Gq  with  6^  in  (A.l). 
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20.  ABSTRACT 


The  estimation  of  a  variance  ratio  6  =  ^ l  is  stu^ied  under  restrictions 

2 

6  >_  9q  or  0  <_  0q  .  We  assume  first  that  we  observe  U.  ^  t.x  ,  independent. 

i 

A  Bayesian  viewpoint  is  taken.  We  then  assume  additional  information  on  T .  is 
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available  in  the  form  of  an  independent  observation  from  a  noncentral  y"  dis¬ 
tribution.  A  natural  application  arises  when  the  are  sums  of  squares  in  a 

variance  components  model. 
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